On Artificial Intelligence and Manipulation

Abstract The increasing diffusion of novel digital and online sociotechnical systems for arational behavioral influence based on Artificial Intelligence (AI), such as social media, microtargeting advertising, personalized search algorithms, has brought about new ways engaging with users, collecting their data potentially influencing behavior. However, these technologies techniques have also raised concerns the potential manipulation, they offer unprecedented capabilities targeting individuals a large scale in more subtle, automated pervasive manner than ever before. This paper, provides narrative review existing literature particular focus role AI associated technologies. Furthermore, it outlines an account manipulation four key requirements: intentionality, asymmetry outcome, non-transparency violation autonomy. I argue that while is not phenomenon, pervasiveness, automaticity, opacity certain may raise type called “digital manipulation”. call manipulation” any exerted through use technology intentionally designed to bypass reason produce outcome between processor (or third party benefits thereof) subject. Drawing insights from psychology, sociology, computer science, identify factors can make or less effective, highlight risks society. conclude qualitatively different human–human interaction physical world. some functional characteristics likely evading subject’s cognitive defenses. could increase probability severity manipulation. violate fundamental principles freedom entitlement related person’s brain mind domain, hence neurorights . To this end, neuroright liberty presented.